Energy-efficient data transfers in radio astronomy with software UDP RDMA

نویسندگان

  • Przemyslaw Lenkiewicz
  • P. Chris Broekema
  • Bernard Metzler
چکیده

Modern radio astronomy relies on very large amounts of data that need to be transferred between various parts of astronomical instruments, over distances that are often in the range of tens or hundreds of kilometres. The Square Kilometre Array (SKA) will be the world’s largest radio telescope, data rates between its components will exceed Terabits per second. This will impose a huge challenge on its data transport system, especially with regard to power consumption. High-speed data transfers using modern off-the-shelf hardware may impose a significant load on the receiving system with respect to CPU and DRAM usage. The SKA has a strict energy budget which demands a new, custom-designed data transport solution. In this paper we present SoftiWARP UDP, an unreliable datagram-based Remote Direct Memory Access (RDMA) protocol, which can significantly increase the energy-efficiency of high-speed data transfers for radio astronomy. We have implemented a fully functional software prototype of such a protocol, supporting RDMA Read and Write operations and zero-copy capabilities. We present mea∗Preprint submitted to Future Generation Computer Systems surements of power consumption and achieved bandwidth and investigate the behaviour of all examined protocols when subjected to packet loss.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Radio Astronomy and eVLBI using KAREN

Kiwi Advanced Research and Education Network (KAREN) has been used to transfer large volumes of radio astronomical data between the AUT Radio Astronomical Observatory at Warkworth, New Zealand and the international organisations with which we are collaborating and conducting observations. Here we report on the current status of connectivity and on the results of testing different data transfer ...

متن کامل

Radio Astronomy Data Transfer and eVLBI using KAREN

Kiwi Advanced Research and Education Network (KAREN) has been used to transfer large volumes of radio astronomical data between the Radio Astronomical Observatory at Warkworth, New Zealand and various international organizations involved in joint projects and VLBI observations. Here we report on the current status of connectivity and on the results of testing different data transfer protocols. ...

متن کامل

Reducing Diff Overhead in Software DSM Systems using RDMA Operations in InfiniBand

Software DSM systems do not perform well because of the combined effects of increase in communication, slow networks and the large overhead associated with processing the coherence protocol. Modern interconnects like Myrinet, Quadrics and InfiniBand offer reliable, low latency (around 5.0 s point-to-point), and high-bandwidth (upto 10.0 Gbps in 4X InfiniBand). These networks also support effici...

متن کامل

Accelerating a Software Radio Astronomy Correlator using FPGA co-processors

Introduction This poster presents and characterises our work on accelerating a software radio astronomy correlator using reconfigurable computing (RC) hardware. Radio astronomy correlation is an embarrassingly parallel signal processing application, which is used heavily in radio astronomy for imaging and other astronomical measurements. Radio astronomy correlators typically operate on huge dat...

متن کامل

Fast and Concurrent RDF Queries with RDMA-Based Distributed Graph Exploration

Many public knowledge bases are represented and stored as RDF graphs, where users can issue structured queries on such graphs using SPARQL. With massive queries over large and constantly growing RDF data, it is imperative that an RDF graph store should provide low latency and high throughput for concurrent query processing. However, prior systems still experience high perquery latency over larg...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Future Generation Comp. Syst.

دوره 79  شماره 

صفحات  -

تاریخ انتشار 2018